


TUESDAY, SEPTEMBER 12, 1978 
PART Il 





. 





DEPARTMENT 
OF LABOR 


Employment and 
Training Administration 


fis 
hl” 


@’ 


GUIDELINES FOR 
REVIEW OF PLANNED 
PERFORMANCE IN 
COMPREHENSIVE 
MANPOWER PROGRAMS 


( 


— 
lai” 





40650 


[FR 4510-30] 
DEPARTMENT OF LABOR 


Employment and Training Administration 


{Field Memorandum 390-78] 


GUIDELINES FOR REVIEW OF PLANNED PER- 
FORMANCE IN COMPREHENSIVE MANPOW- 
ER PROGRAMS 


"AGENCY: Employment and Training 
Administration, Labor. 


ACTION: Notice. 


SUMMARY: In order to provide a 
common framework of national and 
regional’ experience against which to 
compare performance goals and to 
identify potential problems with pro- 
gram design and delivery, the Depart- 
ment of Labor has developed guide- 
lines to review prime sponsors planned 
performance for fiscal year 1979 under 
Title I of the Comprehensive Employ- 
ment and Training Act (CETA) of 
1973, as amended. 

The entire text of Field Memoran- 
dum No. 390-78, which was issued on 
July 26, 1978, is published here to 
inform all interested parties of the De- 
partment’s review procedures. 


For further information contact: 


Robert Colombo, Employment and 
Training Administration, U.S. De- 
partment of Labor, Patrick Henry 
Building, Room 5006, 601 D Street 
NW., Washington, D.C. 20213, tele- 
phone, 202-376-6560. 


FIELD MEMORANDUM No. 390-78—ALL 
REGIONAL ADMINISTRATORS 


Lawrence W. Rogers, Administrator, 
Field Operations. 


CETA Title I Reviw Guidelines for 
Fiscal Year 19793 


1. Purpose. To transmit guidelines 
for the review of CETA title I annual 
plans for fiscal year 1979. 

2. References. FM 209-77; FM 347-77. 

3. Background. Grant review guide- 
lines were implemented for the first 
time to review fiscal year 1977 CETA 
title I grant applications. There was 
some criticism of this initial effort, 
mainly concerning the technical ade- 
quacy of the indicators themselves and 
the fact that participation in the de- 
velopment of the indicators was limit- 
ed. In response to this, a work group, 
consisting of one prime sponsor repre- 
sentative from each region and one 
representative from each _ regional 
office, was created to identify the best 
indicators to measure performance 
and to define methods of computation, 
given the constraints of the existing 
data system. The group produced a 
final document (FM 209-77) setting 
forth 13 performance indicators, 
grouped into four clusters and related 
interpretive factors. The cluster ap- 
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proach was used since CETA repre- 
sents a multiplicity of goals and objec- 
tives for which no single performance 
indicator can adequately measure the 
effectiveness of a local program. 

A subgroup consisting of three prime 
sponsor representatives, three regional 
office representatives, and two nation- 
al office representatives analyzed 
fiscal year 1976 data and develoed a 
mechanism to assist in the review of 
fiscal year 1978 annual plans. The re- 
sulting grant review guidelines include 
three of the original four clusters. The 
earnings cluster was incorporated into 
the interpretive factors section of the 
grant review guidelines because there 
is no formal mechanism in the plan- 
ning process that considers planned 
earnings outcomes. (See FM 347-77.) 

4. Changes Proposed for fiscal year 
1979. In preparation for reviewing 
fiscal year 1979 grants, the work group 
again convened to propose grant 
review guidelines more appropriate for 
fiscal year 1979. The work group was 
generally satisfied with the fiscal year 
1978 process, but proposed the follow- 
ing refinements. 

a. Raise the “‘point of critical inspec- 
tion,” below which prime sponsors 
must explain low planned perform- 
ance, from the quartile to the third. © 

b. Emphasize that prime sponsors 
must explain planned performance 
below their actual performance of the 
prior year. (Throughout this field 
memorandum, “prior year” or “previ- 
ous year” shall mean fiscal year 1977. 
The “current year’ is fiscal year 1978, 
and fiscal year 1979 grants are those 
being reviewed.) 

c. Provide additional supporting data 
to aid prime sponsors with their plan- 
ning and to assist Federal representa- 
tives to understand explanations in 
terms of local conditions. 

d. Clarify and expand the concept of 
incremental improvement from that 
provided for the fiscal year 1978 
review. 

e. Publish the grant review guide- 
lines early enough so that they may be 
more useful in the planning process. 

5. Responsibilities. It will be the re- 
sponsibility of the Federal representa- 
tive to fill out the worksheets and de- 
termine when an explanation will be 
required from a prime sponsor. The 
prime sponsor will have the responsi- 
bility to provide explanations when re- 
quired. 

It was the specific intent of the work 
group that explanations should be 
based on clusters rather than individu- 
al indicators. That is, if only one or 
two indicators within a cluster fall 
into the area requiring explanation by 
a small amount, no explanation may 
be required, especially if the other in- 
dicators are well inside the two-thirds 
requiring no explanation. Only good 
judgment by the Federal representa- 


tive in determining which clusters 
need explanation can maintain flexi- 
bility and prevent needless redtape 
and delays. 

Throughout this memorandum the 
Federal representative is designated as 
the reviewer of the prime sponsor’s 
annual plan. However, some regions 
may prefer to use committees or other 
processes in the review. This is the 
prerogative of the RA, and although 
the term Federal Representative will 
be designated, it is not intended to 
limit the RAs in their choice of review 
staff. 

6. Objectives and mechanism of 
review guidelines. The primary objec- 
tive of such a tool is to provide a 
common framework against which 
prime sponsors and regional offices 
can compare fiscal year 1979 annual 
plans and performance goals to actual 
national and regional experience. 

Data for each indicator are dis- 
played by reference points of lowest 
and highest performance and low and 
high thirds on both a national and re- 
gional level. Planned performance in 
relationship to the regional low or 
high third will be emphasized in the 
plan review. Each indicator cluster will 
include a list of factors the presence or 
absence of which may affect perform- 
ance. Such a list is not intended to be 
all inclusive nor is it intended to sub- 
stitute for the knowledge of a Federal 
representative and prime sponsor staff 
about the appropriateness of a plan. 
The data are intended to provide a 
good starting point from which to 
identify potential problems with pro- 
gram design and delivery before they 
are reflected in poor performance. The 
review guidelines are not to be consid- 
ered as performance standards, since 
there is no requirement that prime 
sponsors perform at any standardized 
level. The reference points of regional 
and national experience serve only as 
convenient benchmarks against which 
prime sponsors plans can be reviewed 
and analyzed, and to identify where 
further explanation would help the 
RA to understand local goals and 
where additional technical assistance 
may be needed. 

Some users may wish to understand 
the distribution of performance more 
precisely than thirds are able to show. 
For these users, optional scattergrams 
plotting each prime sponsor, by 
region, have been provided in attach- 
ment II..To aid in comparison, the 
scattergrams have been divided into 
the same thirds as shown on the 
guideline worksheets. 

7. Indicators. The indicators to be 
used as the basis for the review of 
fiscal year 1979 title I annual plans are 
those developed by the performance 
indicators work group and issued in 
FM 209-77, as revised by the work 
group for fiscal year 1979. However, 
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several indicators have been excluded 
from this exercise; these are in the 
earnings cluster, for which no infor- 
mation is generally available in the 
planning documents, and the expendi- 
ture rate in the fund utilization clus- 
ter, because it is the complement of 
the carryout rate included in these 
review guidelines. The following indi- 
cators have been included. 

a. Termination cluster. 

(1) Positive termination rate: 
Total positive terminations/total 
terminations times 100. 
(2) Entered employment rate, as 
percent of total terminations: 
Entered employment/total ter- 
minations times 100. 
(3) entered employment rate, as 
percent of positive terminations: 
Entered employment/total posi- 
tive terminations times 100. 
(4) Nondirect placement rate, as a 
percent of total terminations: 
Nondirect placements/total ter- 
minations times 100. 
(5) Nondirect placement rate, as a 
percent of entered employment: 
Nondirect placements/entered 
employment times 100. 

b. Cost cluster, where total accured 
expenditures refer to prime sponsor 
CETA funds. 

(1) Cost per positive termination: 
Total accrued expenditures/posi- 

tive terminations. 

(2) Cost per entered employment: 
Total accured expenditures/en- 

tered employment. 

(3) Cost per nondirect placement: 
Total accrued expenditures/Non- 

direct placements 

c. Fund Utilization Cluster 

(1) Carryout rate: 

Funds available—Accrued expenditures/ 
Funds available x 100 

(2) Administrative cost rate: 

Administrative expenditures/Total ac- 
crued expenditures x 100 

8. Description of data: 

a. Data base. Data covering fiscal 
year 1977 for 438 prime sponsors were 
used to compute the 10 indicators and 
to determine national and regional 
thirds against which the prime spon- 
sor’s planned performance will be com- 
pared. The data were obtained from 
the CETA program status summary 
(PSS), financial status report (FSR) 
and _ obligations contained in the grant 
signature sheet and modifications. 
Data from these documents are re- 
ceived in the national office through 
the regional automated system (RAS). 
The RAS data were, in turn, processed 
by statistical package for the social 
sciences (SPSS) which provided most 
of the computations. The data were 
taken from RAS. as of mid-February 
1978. The data are not perfect; about 2 
percent of it is missing or incorrect. 
Cost data in these worksheets have 
been corrected from the draft version. 
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To help identify any additional data 
errors, attachment III.b. provided the 
raw data, reported by prime sponsors, 
from which the indicators are calculat- 
ed. Please notify the national office 
immediately, Attention: TDCR, if any 
major data or computation errors are 
noted. 

b. Computation of thirds. The per- 
formance of each prime sponsor was 
computed for each of the 10 indica- 
tors. The results, expressed as a per- 
centage or dollar cost, were then ar- 
rayed in ascending order from the 
lowest computed value to the highest. 


-This array was divided into three 


equal parts, each part containing the 
performance of 33% percent of all 
prime sponsors. 

c. Interpretive factors. Data for in- 
terpretive factors preprinted on the in- 
terpretive factor worksheet (see at- 
tachment I) include selected client 
characteristics, pre-CETA and post- 
CETA median wages, percent of cumu- 
lative enrollment by activity, percent 
of accrued expenditures by activity 
and the local unemployment rate. 
Data, except for the local unemploy- 
ment rate, were obtained from the 
PSS for enrollment, the FSR for ac- 
crued expenditures and the quarterly 
summary of participant characteristics 
(QSPC) for characteristics and wage 
data. The unemployment rates were 
developed by BLS as the basis for 
fiscal year 1978 allocations. They rep- 
resent fiscal year 1977 annual averages 
and thus correspond to prime sponsor 
performance for the same _ period. 
Prime sponsor fiscal year 1979 plan 
data will be compared against the na- 
tional and regional totals from the 
RAS printout for fiscal year 1977 
dated December 23, 1977. For compari- 
son, the Federal representative should 
fill in the appropriate data in the in- 
terpretive factor worksheet for the 
prime sponsor under review to explain 
program performance. Two columns 
are provided for prime sponsors. In 
the first column the Federal repre- 
sentative will include planned fiscal 
year 1979 data, where available. If 
planning data for chacacteristics and 
wages can be extracted from the nar- 
rative or the significant segments por- 
tion of the PPS, it should be included. 
In the second prime sponsor column, 
the Federal representative should 
copy fiscal year 1977 performance 
data. Instructions for completing 
“sponsor” columns are in attachment 
I @ 


9. Application of review guidelines. 
There are separate worksheets for 
each of the indicator clusters and a 
worksheet for the interpretive factors 
to be utilized in annual plan reviews. 
See attachment I for an explanation 
of the four reference points (the high, 
the low, and the first and second 
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thirds) and instructions for the use of 
the worksheets. ; 

In reviewing prime sponsor planning 
goals, the following procedures should 
apply: ; 

a. Computation of planning goals. 
The Federal representative should 
first compute the fiscal year 1979 per- 
formance goals for each of the indica- 
tors in the three performance clusters 
by substituting cumulative planning 
data through the fourth quarter from 
the PPS and BIS of the fiscal year 
1979 annual plan for the data ele- 
ments of the formulas in the work- 
sheets. The computed values should be 
placed in the “planned for fiscal year 
1979” column of the worksheets. 

b. Comparison to regional thirds. 
Planned performance in relation to 
the regional thirds will be emphasized 
in the review process for each indica- 
tor in the performance clusters to de- 
termine if local planning goals require 
an explanation. The national refer- 
ence points provide additional refer- 
ence points. Use of regional compara- 
tive data as the reference points 
against which prime sponsor plans are 
to be compared takes into account pro- 
grammatic, labor market, and other 
factors unique to a particular region, 
thereby insuring equitable treatment 
for as many prime sponsors as possi- 
ble. 

c. Planned performance requiring ex- 
planation. In general, planned per- 
formance that is (1) not less than the 
prior year’s performance, and (2) in 
the acceptable two-thirds need not be 
explained. Planned performance fall- 
ing above the region’s lowest third for 
the “termination cluster” and below 
the region’s highest third for the ‘‘cost 
cluster” and the carryout rate in the 
“fund utilization cluster” will not nor- 
mally need explanation. Higher posi- 


tive outcome rates and lower costs for - 


positive outcomes and carryout rates 
generally indicate desirable perform- 
ance and should not require explana- 
tion unless there are programmatic or 
other reasons for doing so. Because 
the carryout rate of the “fund utiliza- 
tion cluster” is high for many regions, 
the RA may require an explanation 
for planned carryout rates above some 
fixed level (to be determined by the 
RA) even though planned carryout 
may be below the highest third. What- 
ever point is selected must be realistic 
and achievable by the majority of 
prime sponsors (the national median 
for carryout rate was 20 percent). 

Any planned administrative rates 
that exceed the limits specified in the 
regulations (95.17(b)(8)) must be ex- 
plained to the complete satisfaction of 
the RA. 

RA’s may, in addition, request an ex- 
planation of planned performance in 
the two-thirds which normally re- 
quires no explanation when the re- 
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viewer believes the planning goals are 
unrealistic or serious programmatic 
problems are evident. This may in- 
clude planned performance which dif- 
fers substantially from previous per- 
formance without a significant change 
occurring in program operations, or 
planned performance which may not 
be achievable because of serious ad- 
ministrative, managerial or fiscal prob- 
lems. The RA may determine appro- 
priate situations and the amount of 
detail required for any explanation. 

Explanations must be as complete as 
possible. They should take into ac- 
count the absence or presence of labor 
market, programmatic and other local- 
ly relevant situations which may influ- 
ence performance. 

These factors will be discussed in 
item 10 of this FM. To the extent that 
an explanation relates to a local prob- 
lem (such as a management problem) 
under the control of the prime spon- 
sor, it should include a brief discussion 
of the steps being taken to correct the 
problem. (Note that an indicator in 
the low or high third may result from 
program mix or labor market condi- 
tions and may not reflect a “prob- 
lem.”’) 

ad. Incremental improvement. In 
evaluating plans for fiscal year 1979, 
an additional key element to be con- 
sidered is each sponsor’s previous per- 
formance. The concept of incremental 
improvement is critical to reviewing a 
sponsor’s plan. To determine the 
extent of improvement over previous 
performance, Federal representatives 
should compute (or copy from the lists 
provided) the sponsor’s actual achieve- 
ment for each of the indicators, using 
the fiscal year 1977 data. The results 
should be placed in the column headed 
“Actual fiscal year 1977” of the per- 
formance indicator worksheets. If 
planned performance continues to be 
in the third requiring explanation, but 
reasonable improvement over previous 
performance is planned, such improve- 
ment may serve as adequate explana- 
tion. The knowledge and judgment of 
the reviewer must play a large role in 
these situations, particularly where 
the prime sponsor has a history of 
achieving below plan. A prime sponsor, 
even though planning to perform in 
the two-thirds of all clusters requiring 
no explanation, should not plan lower 
performance than it achieved the 
prior year without explaining why 
unless there has been a drastic change 
in local conditions. Although all spon- 
sors may be expected to improve their 
performance, reviewers must use judg- 
ment; improvement—like growth—has 
limits. 

e. Use of current data. The structure 
of the grant review guidelines has 
made no formal provision for using 
current, mid-year data, because mid- 
year data are not always comparable 
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to end-of-year data. However, if ques- 
tions arise concerning the need to ex- 
plain, or the adequacy of the explana- 
tion provided, the most recent data 
available should be taken into ac- 
count. Current data should be espe- 
cially helpful in helping to decide 
questions concerning incremental im- 
provement. 

10. Interpretive descriptions and in- 
terpretive factors. Each’ performance 
cluster worksheet (see attachment I to 
this FM) contains a preprinted list of 
programmatic and environmental fac- 
tors which may be of assistance in ex- 
plaining, or raising questions about 
prime sponsor planned performance. 
The list, located in the lower left side 
of each worksheet, is not intended to 
be all inclusive. The Federal represent- 
ative may be aware of other factors 
unique to the region or prime sponsor 
area that could explain planned per- 
formance. Among the influential fac- 
tors (whether or not listed) are those 
dealing with the prime sponsor’s pro- 
gram mix, enrollee characteristics, en- 
rollee pre-CETA and _ post-CETA 
wages, and the local unemployment 
rate. 

These factors are all quantifiable 
and are designated as interpretive fac- 
tors. They are contained on a separate 
worksheet‘in Attachment I for conven- 
ience -of comparing these factors and 
using them in combination to explain 
planned performance. Since these fac- 
tors, except for enrollee wages and the 
local unemployment rate, can be 
broken down by their proportion of 
the prime sponsor’s total program, 
each factor can be compared with 
other elements of the sponsor’s pro- 
gram and regional experience data. 

The interpretive factors worksheet 
will contain regional and national ex- 
perience data for fiscal year 1977 
which has been preprinted on the 
worksheets. Prime sponsor data to be 
compared within the program and 
with regional totals will be filled in by 
the Federal Representative in the 
blank columns (see Attachment I, sec- 
tion II, for additional instructions). 

Page 5 of Attachment I contains a 
short description of the use of each of 
the interpretive factor groups. The de- 
scription is limited but should help the 
Federal Representative to understand 
how the various interpretive factors 
may be used. The following examples 
provide the Federal Representative 
with a fuller range of implications 
that these factors may have on 
planned performance: 

a Enrollee Characteristics. The Fed- 
eral Representative should pay partic- 
ular attention to the types of partici- 
pants to be enrolled in the program 
and the possible correlations to the 
percent of expenditures, cumulative 
enrollments by program activity, 
planned performance goals, and pro- 


gram objectives. Prime sponsors may 
develop and operate programs de- 
signed to increase the employability of 
particular groups of enrollees, with 
placement in unsubsidized employ- 
ment not being a program objective. A 
prime sponsor proposing to serve a sig- 
nificant number of youth and full- 
time students may be expected to allo- 
cate a sizable portion of funds for 
work experience activities and have a 
sizable percentage of enrollments in 
work experience activities, accompa- 
nied by a relatively low planned ‘“‘en- 
tered employment rate,” a relatively 
high planned “cost per entered em- 
ployment,” and a relatively high 
planned ‘positive termination rate.” 
The Federal Representative should 
then compare planned performance 
goals for the affected indicators 
against regional comparative data for 
the interpretive factors. This compari- 
son should help to assess planned per- 
formance. 

Prime sponsors operating programs 
or activities stressing service to other 
‘“‘hard-to-place” groups, e.g., minor- 
ities, persons with limited English- 
speaking ability, older workers and 
handicapped, may reasonably be ex- 
pected to propose relatively low posi- 
tive termination rates through fre- 
quent tunover, low entered employ- 
ment rates, high costs per positive ter- 
mination and high costs per entered 
employment. 

b. Program Mix. Prime sponsors may 
plan to allocate a sizable portion of 
funds to classroom training and OJT. 
These are placement-related activities 
and planned performance should re- 
flect this, unless the classroom train- 
ing includes much remedial education. 
Planned goals for other indicators 
may be similarly affected by such a 
distribution of funds. The Federal 
Representative should review regional 
data for the affected indicators and 
the interpretive factors for possible 
explanation of the sponsor’s planned 
performance. 

The interpretive factors and other 
environmental and programmatic in- 
fluences must be used with care. Al- ’ 
though there may be an established 
correlation (see page 5 of Attachment 
I) among some of these with the plan- 
ning goals, there are many nonmea- 
surable factors which can completely 
outweigh the correlations, many of 
which are weak. Initial multiple re- 
gression equations show that the 10 
best factors were “able to explain” an 
average of about 40 percent of the 
variation between prime sponsors for 
the performance indicators. This 
means that the majority (about 60 
percent) of the variation in prime 
sponsor performance is not predictable 
by the data available. It will be incum- 
bent on the Federal Representative, 
who is knowledgeable concerning the 
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environmental and programmatic as- 
pects of the prime sponsor, to make 
judgments as to the factors and the 
strength of the factors considered to 
be operating to determine if they are 
- adequate to explain planned perform- 
ance. 

11. Additional Information. The na- 
tional office is currently preparing a 
statistical analysis of a variety of fac- 
tors affecting performance. The Per- 
formance Indicators Work Group rec- 
ommended that this study, with up- 
dates, be published quarterly. 

12. Training. 

a. Federal Staff. In order to insure a 
uniform understanding of how to 
apply the guidelines in your region, it 
is recommended that regional staff be 
trained as early as possible. Regional 
offices may request training from the 
national office. Arrangements will be 
made for national staff or members of 


the Performance Indicators Work - 


Group to assist in training in the re- 
gions. 

Although the fiscal year 1979 grant 
narratives will be abbreviated because 
of uncertainty relating to CETA 
reauthorization, these review guide- 
lines were designed to aid in the 


review of the PPS and BIS. Since 
these forms are not expected to 
change during fiscal year 1979, it 
seems most reasonable to review pro- 
posed performance on a full year 


basis. RA’s, of course, must determine 
- what level of detail is appropriate for 
their fiscal year 1979 grant reviews. 

13. Action Required. RA’s should dis- 
tribute this FM as soon as possible to 
regional staff, prime sponsors and any 
other person. requiring this informa- 
tion. They should also inform prime 
sponsors and others that these guide- 
lines will be published in the FEDERAL 
REGISTER. 

14. Inquiries. Questions should be di- 
rected to John Weigant or Henry Ro- 
senbloom on 376-6580 or Nan Beckley 
on 376-6575. 

15. Attachments. 

I. Worksheets 
(RA’s only). 

II. Performance Indicator Scatter- 
grams. : 

III. Prime sponsor lists by region, of 
performance indicators based on fiscal 
year 1977 performance (RA’s are au- 
thorized to substitute RAS data where 
it is more current or convenient.) 
(RA’s only). 


Note. For presentation in the FEDERAL 
REGISTER, only Attachments I and II of this 
field memorandum will be reproduced. How- 
ever, performance data contained in Attach- 
ment III, which will not be reproduced, are 
also contained in the Performance Indicator 
Scattergrams of Attachment II, although 
prime sponsors are not identified. 


and _ Instructions 


NOTICES 


WORKSHEETS 


I. Performance Cluster Worksheets. 
Separate worksheets have been devel- 
oped for each of the indicator clusters 
which include a list of interpretive en- 
vironmental and programmatic factors 
to be used in plan reviews. The follow- 
ing will describe the format of the 
cluster worksheets and general proce- 
dure for review. 

A. The upper part of each worksheet 
lists the component parts of the clus- 
ter, the computation formula, and a 
space for entering planned outcomes 
for the prime sponsor being reviewed. 
Next to the planned result insert the 
prime sponsor’s actual performance 
during the prior year. Comparative 
data, to be used as reference points in 
either percents or dollars, are pre- 
printed. The comparative data will be 
displayed for both nationai and for in- 
dividual regions. Four’ reference 
points are included: 

1. Lowest performance in 
region/Nation (low). 

2. First third in the region/Nation 
(33-percent). 

3. Second third in the region/Nation 
(67 percent). 

4. Highest performance in 
region/Nation (high). 

The low third refers to the point 
where 33'% percent of the prime spon- 
sors fall below in performance. 

The high third refers to the point in 
performance which 33% percent of the 
sponsors fall above. 

The middle third includers scores be- 
tween the 33%-percent value and the 
66%s-percent value. 

B. The bottom left hand side of the 
worksheets contains a list of interpre- 
tive descriptions. These environmental 
and progammatic factors may influ- 
ence performance and may be used as 
a basis for explaining deviations of 
planning goals. The list is not all-in- 
clusive; Federal Representatives 
should be aware of other factors 
unique to the region of sponsor. In 
any event, is will be incumbent upon 
the Federal Representative (working 
with the prime sponsors) to document 
the absence or presence of influential 
factors. Important factors that can be 
helpful in explaining planned per- 
formance are those dealing with pro- 
gram mix, enrollee characteristics, 
pre-CETA and post-CETA wages and 
the local unemployment rate. These 
interpretive factors are listed on a sep- 
arate worksheet of the review guide- 
line package. This worksheet will be 
discussed in section II of this attach- 
ment. 

C. The bottom right hand side of the 
worksheets provides space for explana- 
tion of planned performance. Explana- 
tion is required as described in 9.c. of 
this FM. 

II. Interpretive Factors. An addition- 
al worksheet, assisting Federal Repre- 


the 


the 


40653 


sentatives in displaying performance 
in terms of various interpretive fac- 
tors, is contained in the worksheet 
package. These factors should be used 
in conjunction with the influential 
factors listed on the indicator cluster 
worksheets as a basis to explain prime 
sponsor performance. The interpretive 
factors include categories of program 
mix, selected enrollee characteristics, 
pre-CETA and post-CETA wages and 
local unemployment rates. Page 5 of 
this Attachment contains a short de- 
scription on the use of each section of 
the interpretive factors. 


The worksheet contains four col- 
umns of data. In the first column, the 
Federal Representative should insert 
the planned data for the grant year 
being reviewed, as available. In the 
second column, the Federal Repre- 
sentative should insert the prime 
sponsor’s performance for the previ- 
ous year. In the final two columns cor- 
responding regional and national data 
have been preprinted. The prime spon- 
sor data should be filled in as follows. 


A. PRIME SPONSOR PLANNING DATA 


1. Program Mix—Percent of Expendi- 
tures by Program Activity. Obtain data 
from section F. of the BIS of the fiscal 
year 1979 annual plan. Cumulative 
fourth quarter expenditure data for 
each activity from F.2.A. through 
F.2.f. should be divided by cumulative 
fourth quarter total projected expend- 
itures by program. F.2. The result 
should be multiplied by 100 and placed 
in the “sponsor” column beside the ap- 
propriate activity. 


2. Program Mix—Pecent of Cumula- 
tive Enrollment by Program Activity. 
First determine combined cumulative 
fourth quarter enrollment by adding 
the cumulative (total) fourth quarter 
enrollment in each program activity 
listed in section II of the PPS except 
Classroom Training-Voc. Ed. (Voc. Ed. 
enrollment is excluded because the 
data are too variable to be a useful in- 
dicator, and are often reported under 
classroom training—prime sponsor.) 
Then divide the fourth quarter cumu- 
lative enrollment for each of the pro- 
gram activities by the combined cumu- 
lative enrollment. Multiply by 100 to 
give the percent and record in the ap- 
propriate space. Example: Percent en- 
rollment in classroom training equals: 


PPS: II.A (4th Q)(a) X 100 
PPS (4th Q)(a): IL.A + II.C + II.D + II.E 





3. Enrollee Characteristics. Planned 
enrollment by age, sex, and race 
should be available in a table located 
in the grant narrative under the sec- 
tion “Population To Be Served” (Sec- 
tion ITI.B.A.1. of the ‘Forms Prepara- 
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tion Handbook’’). Corresponding per- 
centages should be recorded on the in- 
terpretive factors worksheet. Enroll- 
ment for the other characteristics is 
not routinely planned, so it is not nec- 
essary to insert planning data where 
none exists. However, if the prime 
sponsor happens to plan for Signifi- 
cant Segments of the Population that 
exactly correspond to any of the listed 
categories, the planning data may be 
inserted. Leave blank all categories for 
which there is no data; it will be as- 
sumed that last year’s performance 
will be repeated. Considerable judg- 
ment must be exercised by Federal 
Representatives in interpreting the 
impact of these factors and their 
changes over time. 

4. Median Wages, Unemployment 
Rates. As with planned enrollee char- 
acteristics, this data shouldbe includ- 
ed only if there is documentation in 
the grant narrative that exactly corre- 
sponds. In the great majority of cases, 
these spaces should be left blank. 

B. Prime Sponsor Previous Perform- 
ance. Performance data as of fourth 
quarter fiscal year 1977 should be in- 
serted as appropriate. Federal Repre- 
sentatives may use two sources for the 
data: the prime sponsor’s Quarterly 
Reports, or the RAS reports which 
were generated from the original 
Quarterly Reports. 

1. Program Mix—Percentage of Er- 
penditures by Program Activity. Use 
column B of the FSR for fourth quar- 
ter fiscal year 1977 to determine per- 
centages. For example, percent of ex- 
penditures for PSE equals: 





FSR 7.8.3 (Wages + Fringes + Other) X 100 
FSR 7.B.7 


2. Program Mix—Percentage of Cu- 
mulative Enrollment by Program Ac- 
tivity. Use section II of PSS using pro- 
cedures similar to those described in 
paragraph A.2. above. Do not include 
classroom training—vocational educa- 
tion in any calculations. 

3. Enrollee Characteristics. Compute 
percentages from the fiscal year 1977 
fourth quarter QSPC or RAS prin- 
touts. Use data for total participants 
(column B of the QSPC). 

4. Median Wages. Median wages 
have been estimated using standard 
methods for grouped data. (See a 
“Forms Preparation Handbook,” May 
1974.) Originally, all wage categories 
were included, but it was discovered 
that for some prime sponsors a major- 
ity of their placements had no previ- 
ous wage. This caused the pre-CETA 


NOTICES 


median wage to be a zero and the re- 
sultant increase in median wage was 
unrealistically high. The problem was 
resolved by excluding those without 
previous wages from the computation. 
However, eliminating those without 
previous wages skews actual perform- 
ance in the other direction. Recogniz- 
ing the merits of both positions, and 
that more complete data should be 
helpful in explaining performance, 
both computations have been made. 
Wherever the pre-CETA median wage 
would be zero, the percentage of par- 
ticipants with no previous wage is 
printed. 

The “official” pre-CETA median 
wage excludes those with no previous 
earnings and is the preferred interpre- 
tive factor to explain performance re- 
lated to wage increases. However, the 
other pre-CETA median wage may be 
included in explanations where it adds 
meaning. The “official” figure is con- 
tained on the prime sponsor lists 
under the column headed ‘“‘Pre-CETA, 
w/o O’s.” It is followed by the figure 
including zero pre-CETA wages. Post- 
CETA median wages are not affected 
by either choice. 


5.Unemployment Rates. Unemploy- 
ment rate data are drawn from BLS 
annual averages for 1977 that were 
used to allocate funds for FY ’78. 
They are printed on the data sheets of 
prime sponsor data. The regional and 
national unemployment rates shown 
on the Interpretive Factors Work- 
sheets were aggregated from _ the 
prime sponsor data. The displayed 
rates should be compared with unem- 
ployment rates of recent periods 
noting trends that may assist in ex- 
plaining differences. 


UsE OF INTERPRETIVE FACTORS— 
GENERAL OBSERVATIONS 


1. Program Miz. The size of a youth 
work experience program’ explains 
more of the variation in placement 
rates and “costs per” than any other 
sinlge set of factors. Youth work expe- 
rience programs generally lower place- 
ment rates, raise positive termination 
rates, raise costs per placement, and 
lower costs per positive termination. A 
large youth work experience program 
is characterized by large percentages 
of fulltime students, youth age 18 and 
under, “other labor force,” and a high 
proportion of cumulative enrollment 
in the work experience program activi- 
ty. A relatively low cost per enroll- 
ment in work experience (cumulative) 
also suggests an in-school type pro- 
gram. (NoTe.—“Other labor force” 


participants may no longer correlate 
with a youth work experience program 
due to changes in instructions for in- 
tertitle transfers between title I and 
title III summer programs.) 

High proportions of classroom train- 
ing and OJT expenditures and enroll- 
ments often lead to higher nondirect 
placement rates and costs. High PSE 
and work experience expenditures and 
enrollments usually lead to low place- 
ment rates and high “costs per,” espe- 
cially if cost per enrollee is high, as in 
prevailing-wage work experience. Sig- 
nificant direct placement activity may 
be indicated by relatively high expend- 
itures for services to participants. 
Direct placements will also generally 
lower ‘“‘costs per’ and raise the posi- 
tive termination and entered employ- 
ment rates. 

2. Enrollee Characteristics. All en- 
roliee characteristics listed among the 
interpretive factor have, on the aver- 
age, lower entered employment rates 
than their counterparts. Prime spon- 
sors who serve relatively large propor- 
tions of these difficult-to-place groups 
can be expected to have lower rates 
and higher cost per. 

3. Median Wages. Higher post-CETA 
wages and increased wages from per- 
to post-CETA may provide evidence 
for an emphasis on higher quality., 
longer tern (more expensive) training 
in higher skilled jobs. Large increases 


which result from low pre-CETA 


wages may also indicate a high propor- 
tion of participants without prior work 
experience, or with limited or old work 
experience. 

4. Unemployment Rates. Local unem- 
ployment rates are negatively corrlat- 
ed with all of the placement rates and 
are positively correlated with the costs 
per placement. That is, prime sponsors 
with higher than average unemploy- 
ment rates can expect proportionately 
more costly programs with lower 
placement rates. 


DISPLAYING WORKSHEETS IN THE 
‘FEDERAL REGISTER”’ 


For purposes of publication in the 
FEDERAL REGISTER, the complete set of 
worksheets for Region I, only, will be 
displayed. For the other regions (II 
through X), only the regional numeri- 
cal data will be provided. These data 
can be substituted for regional data in 
Region I worksheets for the appropri- 
ate performance indicator clusters and 
interpretive factors to obtain the 
worksheets for any other region. Na- 
tional data are the same for all regions 
and are contained in the worksheets 
for Region I. 
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NOTICES 
PRIME SPONSOR 





FEDERAL REPRESENTATIVE 





INTERPRETIVE FACTORS 





Prime Sponsor Data** 
A. Program Mix Planned, Actual, 
FY 1979 FY 1977 








FY 1977 Averages 





Region 


I 


National 





1. Percent of Expenditures 





Classroom Training 
On-the-Job Training 
Public Service Employment 
Work Experience 

Services to Participants 
Other Activities 




















Percent of Cumulative Enrollments 





Classroom--Prime Sponsor 
On-the-Job Training 
Public Service Employment 
Work Experience 














Enrollee Characteristics 





1. Females 
2 Youth: 18 and under 
19 - 21 















































3. Education: 8 and under 
9-11 
Income: AFDC 
Other Welfare 
Economically Disadvantaged 
Ethnic: Black 
Spanish American 
Handicapped 
Full-time Student 
Offender 














+] ot] YL 















































+] e] el LF 


Other Labor Force 





Sul on &] Sl a] Oo] &] 1 oo] of BH] oj 





C.. Median Wage 





1. Post-CETA $ 








2. Pre-CETA (excluding no previous wage) $ 











Increase (Decrease) $ 





4. Pre-CETA (including no previous wage) $ 








5. Increase (Decrease) from Post-CETA 





D. Unemployment Rate 











* Optional Data--Insert as available 
** To be filled in by Federal Representative 
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ATTACHEMENT II To FM No. 390-78 


SCATTERGRAMS OF KEY PERFORMANCE 
INDICATORS 

Scattergrams prepared by the SPSS 
computer program have been included 
so that users can graphically see the 
variation in the indicators. Regions 
are plotted on the vertical axis with 
one line for each region. The value for 
the performance indicator is shown on 
the horizontal axis. The national dis- 
tribution is plotted on two lines at the 
bottom of the graph, repeating the re- 
gional plots above it. Each asterisk(*) 
indicates a single occurrence. Multiple 
occurrences are shown by a one-digit 
number from 2 to 8. Nine or more oc- 
curences are shown by a “9”. 

How to Read Scattergrams. Scatter- 
grams can be used in several diffent 
ways. The easiest is simple inspection 
to see how the data are distributed, 


NOTICES 


and what are the lows, the highs, and 
the median. To aid in visual under- 
standing, the data hve been divided 
into low, middle, and high thirds. Such 
a division also makes it easier to see 
differences between regions. 


Some users will what to know the 
exact value of a particular occurrence 
or plotted point. To determine the 
value of any particuar occurrence for 
an indicator, place a ruler vertically so 
that it intersects the point (a digit or 
**"’) and read the value from the scale 
at the top or bottom of the page. The 
top and bottom scales are the same, al- 
though different reference values are 
printed. Use whichever reference value 
is most convenient. The region to 
which the point belongs can be read 
from either side scale. Once the value 
has been determined, it is then possi- 
ble to search the lists of prime spon- 


40669 


sors to see which one is represented by 
the particular plotted point.* 

This process can be reversed. To find 
which point on the scattergram repre- 
sents a given prime sponsor first find 
the value of the desired indicator for 
that prime sponsor from the prime 
sponsor lists (Attachment III).' Then 
locate that value on the top and 
bottom scales of the scattergram for 
the desired indicator. A ruler place 
through the value located on the top 
and bottom scales should intersect the 
prime sponsor’s plotted point for his 
region. 


‘Attachment III of this field memoran- 
dum, containing a listing of performance by 
prime sponsor, is not being provided for the 
FEDERAL REGISTER. Therefore, it will not be 
possible to identify the performance of spe- 
cific prime sponsors by using the scatter- 
grams. 


FEDERAL REGISTER, VOL. 43, NO. 177—TUESDAY, SEPTEMBER 12, 1978 





8L6L ‘ZL WIGWALdIS ‘AVOSINI—ZLI ‘ON ‘Eb “IOA ‘831SID3¥ 143034 


GALLISOd FUV LVWL SNOLLVNIWUAL TIV 40 FOVINDOWad 
00°00! 00°06 00°08 00°OL 00°09 00°nsS 00°0% oo°or 00°02 o0oO°oT ora 


OP mn nn ba rn han nh rn fn rn tn pn tn tn ment men nm ta nnd mn tran = at en nn t an a tmnt nm mnt mann tan nat onnnt® 
* 8 ss EZEZ 449429968 6681598681 S99b boo Z222eC.. 2 sul wes & 
® %ZEE%4LSSSSB9L8669666626606 SES SL 82 5eZEv2722 * ee 2 


¥-1 SNOIDgY "IVNOI.LVN 


OI-% SNOID3Y 


= se % Zao 2 @ ¢ 088 Ze 


-=* 7 quar 
QuIHL HOIH a10d1W 


* QUI MOI 


* 8 eee 228 eEZo9EZEs ZZEZZEse 422 we & 8 


] 





2 E242ESe wo2aCaseee #2 


*& soeeleZeEsSeseeZEZ Yeetead 22€ 


ee eZ E8EZ EZZZZEZEZVE VZ9HOZECY E w2eZue2 s e088 


~#.. €92 @ s2eecZeekZ 2%¢ _bos see 0 








- 


ade tee hate hot hh ht a te ee ee ee ee 


ee 2eZ2ZeEZ94eZeZE 4422 92 9 48 





° * Ps * 00°01 


Dnt rn nf nn fen a Fa nf a $a t= = + Brn ban nh mn tan to en tan n= tnt ant 
00°S6 00°S9 00°S2 00°S9 00°SS 00°S% 00°SE 00°S2 oo°st co°s 
3AVUY NOVIVNIWSIL JATLISOd-WH3LSOdY ISSONDV) ° NOISAW «(NMDO) JU WVU9UILIVIS 

SNOJ93d ee 


' 
| 
I 
+ 
1 
I 
1 
I 
+ 
i 
I 
i 
i 
+ 
I 
I 
I 
I 
+ 
I 
7 
I 
J 
+ 
! 
J 
} 
i 
+ 
I 
1 
| 
] 
+ 
! 
i 
i 
I 
+ 
| 
} 
| 
5 
. 
i 
i 
I 
| 
+ 
e 





“ $4Wwhdd BE%--VAVG Wd 9 IdSD *SSd “HSS LAK HILO Ie ‘ 
84/42/40 _— S3IN3IDS WIDUS JHL HOS BOVIVd WIPISHAVIS 





S261 ‘Zi WIGWILdIS ‘AVGSINI—ZZL ‘ON ‘Eb “IOA ‘431SIOIY 1V8IGIS 


INDOUId «=* SNOLLVNINYAL TIV JO ‘3LVa INSWAOIdWa GaNaING 
oo0°0ct 00°06 on°os 00°02 00°09 00°Os% 00°04 00 °Os 00°"7 or*ol ora 


Pym mann ann Ban hn nd nt nt on tn nt nt men tn fo tnn nt nm mnt dann t enn ton nt man a tenn tenn tenant? 
¥-1 SNOIDSY * se *. wee ol we we ZZ aeZZOZLES VaGlSsVGLENFOLILERGONGZLILEG!S Fett Ses on ¥ 


Ol-5 SNOLDSS 2 = #2s aLefESssTeSAVEVEVEVOL TED POOL STL LANES TVET er eps ce we ‘ } ‘IWNOLLWN 


* © 2s #& 2) 2% * @ aux Se “ee 


GuiHL HOIH (UIHL wIdGIW GuIHL S071 


es @ @ €2% Exel Yaw 42230 2 Zee H2%72 22e7a & Ze «2 
eZeben2t us SEa2 2 


CeesF2Z9F4eZE ah ZEEZZZZxa eaZe 


% weneee7ZSEZEZ CGEEY SHES CCE ZoecZeZe 2 Ke 


NOTICES 


2 #2 | #22 n0°0T 


4 Dm am a a a 9 a 8 a a a he fh a a he nf a on a he og nf ef ne ewe tt 


00°S6 00°S8 00°SL 00°S9 o0o°ss 00°sS 00°SE 00°S2 00°ST on°s 


SNOLLVNIWUAL 11 30 & *31VY ANIWAO WWI O3N31INZ 1039VIdU (SSOUIV) NOI9S3S8 «NKNO? 30 WVNONFILEVIS 
SNOI939 ee 


00°Oo! 


eine ee Bee he ee ee ee ee 


I 
1 
I 
} 
+ 
i 
i 
I 
I 
+ 
I 
} 
i 
1 
+ 
i 
I 
I 
I 
* 
1 
1 
I 
A 
+ 
I 
t 
I 
j 
+ 
} 
i 
} 
j 
4 
i 
1 
{ 
i 
4 
I 
I 
1 
i 
+ 
L} 
i 
I 
i 
+ 
id 





 S$3W1Yd BE%--ViVO IW1 9 2dSO *SSd “USS LAS VIO HLY 
82/42/90 S3IN319S WIINS IHL AVS JOVWIVE WITASTAVAS 





8261 ‘ZL WIGWALdIS ‘AVGSINI—ZZI “ON ‘Eb “IOA ‘831SIDIY 1V8I034 


- INDOUad 9‘ SNOLLVNIWUAL Ty JO SALVE INSNAOVId LOZUIGNON 
oo°oo! 00°06 00°08 oo°uL 00°09 00°0S 00°04 00°08 00°n2 oarnt oa 


me we 9 FO 8 we of ome we f me wn fo oe = Fe we Hh oe fh ee ee trowatoe=Piacwet=onnt PET Mee ceetooeantowsefaenen? —-<-—-—-4* 


W-1 SNOIDaY * - : ae Sh COZTSEGSGs 2284GZUZ2EG IE UEGUGEGYERIIIVRSI4UMET sat o 67 * 


O1-9 SNOIO3Y eee 0 v2ee €2 #Z€2ZZZ7E9ZSHSZS SLNBGHNL ESI OSESE DOOL*9OGULEZ aad & » * 
es st) ff * weZ2ae Zale « © 07 0 & 
CR eee a GuluL 
GalHL wd g'10GIH @uIHL MOT 
ae 34 #2€ © #2 #2 ZEZ2EEZ ene ZE * * 5% 


asf e€s « sa 2 aS €2 « 


} "IVNOLLVN 


 eeZ€ Zeb aZ2aZ25e4SS72ZE€ eee2 eZ 2 





ee © & 8€ ee€ ZE9GE eZEZZ>ZZEESEFOEERZEZ auez 6 


NOTICES 
* 


bl et Mote eed ho hd hn tr a eee eee eee eee 








eS eel ZheZe 22 #4794 


“ . «2 * oorot 
Bm a Bn 8 rn bmn = tn § en a Han nn at 4 $—----+ Pr an dn ma tn $a tt 
00°S6 0o°ss o0°sé 00°S9 00°SS 00 °SE 00°S2 oo°st 00°S 
SNOLLYNIWNAL FIV 4O *31V¥ AN3W3IVId LISYTOQNUN LYIGNONY (SSOUdV) NOI93N (hProd) JO WVUDUILAVIS 


SNOIJSY 2. ek 


00°ol 


i 
4 
I 
J 
’ 
J 
1 
I 
i 
4 
I 
I 
4 
I 
. 
I 
] 
b 
J 
4 
i 
I 
i 
| 
+ 
i 
1 
I 
L} 
+ 
I 
I 
i} 
i 
v 
j 
i 
I 
i 
+ 
L 
j 
i 
1 
’ 
I 
1 
5 
i 
+ 
e 





S3W1Ud BE%--VIVO IWw1 9 3JdSO *SSd *USS LLAS BIO HL F 


€ 39Vd 82/%2/%0 SIINIIIS WIIOS JHA HOS 3IOVIDVd WWITISHAVAS 





S461 ‘TL MIAWILdIS ‘AVASINI—ZZL ‘ON ‘Eb “IOA ‘HFLSIO3Y 1 4IGT4 


INDOUad «=‘SNOLLYNIWAAL FATLISOd 40 ‘ALVa INANAOTdNa CaNFLNT 
00°00 00°06 00°08 oo°ol 00°a? 00°0S C0°O% O0° o£ an*32 Coral 0°O 


e anak dla octal bata Retcbee ae Scies fs -4----4----t----} Ee eo ath me we pe mmm Fa ee gee nm fae of wooo * 


b-1 SNOTS34 . @ # sebZeenZE Ce ohaZZZEZ9Z awh Caf WL CECGHEZESESGL C2EE Zab COMLE aE GAZE CZ adzZaue Zaz ae + « +€) aone 
O1-G SNOTOgU . Es€> en€ 2402 9FE COSHGOLS HFG LSE HOSE OESORLESEgEZE ON IZ Fes w2Ef9E & 2d ® > 


* 2% é +2 *e + 


QuIHL HSIH GuInL aTAGIK @aLHL MOT 


* ¢ © 2% eeE 22 aecZe2 * 8 e226 42 Cee 46 2 Cree 


2 * * 22) €e 48€2 


e€ee 9 62 ZaeeefE € #22 Zew wZt ee ££ Oe 82 & He e KEE 


whan 22 e222 ee2Zecee EZEsZeFEZEZSeZZEZ 4a w EZ 


NOTICES 


* 942€. 4€€ ge 4% 252 22% __ #8 


e s* 3 -/ ce wet eee 2 


' 


oP es me oe eee ee ee ee et et oe et oe ee 


% #22 #Zs 2 2E€s es 4% & & ¢ 


* e est ies, - ee *% 


@—---4t----+ $----+ $————4 Reso euoee + $a nna tt tt 
00°S6 00°S8 00°s!L 00°S9 00°SS 00"s9 O0°SE 00°SZ oo°st o0°s 


SNOILVINYUSL SAILISOd 40 *31VY ANIWAOD IdW3 GCIYIINI dOIIV Ady (SSOUIV) NUI9S3Y INMOO?P 430 WVN9DHALIVIS 
SNOTO SY snd 


00°Oot 90°oT 


I 
1 
i 
i 
+ 
! 
i 
! 
i 
+ 
I 
: 
i 
1 
+ 
i} 
i 
1 
i 
' 
I 
i 
i 
i 
* 
5 
i 
i 
I 
+ 
5 
I 
i] 
i 
io 
i 
i 
I 
i 
* 
t 
I 
i 
i 
+ 
I 
I 
I 
i 
+ 
e 











SIWIYd BEY--VIVO IH1 2 3dSO *SSd “US4 LZLA4 BIO HLS 
81/42/40 SIINIEIS WINS FNL YN4 JZOVNIVd WIILSTLVLS 





8261 ‘ZL BIGWILdIS ‘AVGSINI—ZZL ‘ON ‘Eb “IOA ‘831819348 1V89034 


SINANGIVId LOAWIGNON JUV LVHL INAWAOIdWa ONIYSINS ASOHL JO FOVINIOUTd 
oo°ool 00°06 00°08 00°O2 00°09 00°OSs 00°NY o0°O! 00°02 FOOT oro 


OR Aba Fa a an bm nn hn tnd nn nd nh nn t mmm Femme mn nda nn dm nn ben nn bn mnt mmm tome = ton mntannnt® 
Y-1t SNOISTY FOBGSOOSECEISZSZEEsenad e22uGh C(Cs t Za2ae a6 wm 642 8 ae * ¢ "IVNOLLVN 
O1-3 SNOIDTY 16662968 6699S6$e29S22 22E9Z4S ZEZEsZoZ we wkE Ce 27 *¢ * ue 
1 . sean atges 
j 
i] 
oo*l +80 Zea * rare oe 8 8 
i : oe : a 
GuINL HOIH J GUIHL F1GGIN GaInL M01 


‘ 


00°2 6Eesess seestesZ e046 £2 2 22a 2 


; 2 e 92 


2Ze 2 esse 2 & 8 


OLSEeoeEZekeees EZee sZEEste Z 


—— — — 


eaeee 6 02 Ze 


wr 
rev) 
Y 
= 
o 
z 


‘oe mee ae 6 we ee oe eo we ee me So ee ee ee ee ie SO te cc 


C22 2 7Se 22. Cage te 2 ee 28 8 ££. 


a) 
> 
=> 

. 
e 


‘ 
‘ 
‘ 
' 


i=] 
—] 

° 
e 


eZeCCeeces #4 & & 


t 
‘ 
‘ 


®€ 22s * 2% 2 * 00°OT 


Dm oa ha a ha 9 nn = $e § np ow fa op on tt eo on tot t----¢ + Fon ma tame nm tan mn tonnnt 
00°S6 00°se 00°SG4£ 00°sS9 00°SS 00°S% 0O°SE 00°SZ 00°st 00°sS 


SINAWED VId 40 S31 V8 INIW3ZIVId 1DSTIGNON-3YIONONY (SSOUIV) NOI9I4 aah” 30 WVUdHILIVIS 
NOT ay 


00°o! 


© me me oe we 6 we we me 6 oe ew ee 6 oe oe ie oe ee ee Oe ee ee et et ee eS to ot oe + 


lente Meee ne hn ee ne | 





S3IW1Yd BE%--VIVO IWT 3 IdSO *SSd “USS LEAS BIO Hid : 
81/42/90 S39N319S WID0S 3H BPS BYVWIVG BWITASTAVAS 





BZ6l ‘TL WIGW3LdaS ‘AWVGSINI—ZZ1 “ON ‘Eb “IOA ‘83181934 1v483G34 


SYVTION ‘NOLLWIWYSL SALLISOd Yad SOD 
0.0°0009 00°00%S C0°008% 00° 0029 00° 009€ 00°000r 00°00%2 oo°cout o0°no2I 00 °HOS 0°0 


© hw chaos fasen fa sen feces fosen§ sna §oseet essa §aSes} eee} ens of Ba snteeeng a naa fesesgeenatecnatoweetecce?t ¥ 


y-1 suozBay- 4 a2 * 2 #8 Z wadZ ZZwZ9SEELYZEVEZEMLESYZOFBSISSSLELIE ES Ye Seve 2 se 


OI-G suoysay~ » * al tue Ze€ aeeee 44724 ere ee ee ee ee eee 22022237 


ll El le I le eet i Reali _— — a me 
SNOLSSY 


‘IWNOLLVN — 


> 
i] 

. 
a 


ae 5 * ¥ 


j 
' 
‘ 
t 


GUIHL HOIR GUIHL a1dadiw GuInL MOT 


& ee & eeZEe BEL eEae 22E8 ECees CZeveaete + os 


ss #eee72 wee & 2 Zee€2 ceZ€ 


Z eae & 2 oe oe vib & CHEES 2292 BE2 2ae2Z 


| 
| 





e 8 ven Ee 49 e2euaZe & HZZESZZ>ZZ5ZZeEEC eZ OVE See = 22 


oO! 

i] 
° 

wo 


4) 
WS 
Y 
be 
ce) 
r 4 





| 


ee ee) 
[=] 
i 
. 
~ 


| 
| 
| 
| 


| 
' 


#2 € 6€2 *& €€2 2 2 #252 


foe me me ee lie oe ee 


‘ 
t 
' 


a ee ee ee ee Me eee eed 


00°01 hd 
21694 ° #---- $—--- 4-4-8 = - $= 
00°002S 00°OO0IS 00°00S4 00°O006E 00° O00€E 00 °00L2 00 °00T2 00 °00ST 00°006 CO° COE 


NOTAVNIWH3L JATLISUd w3d ASOD WYILSOdS (SSOUIV) NOP938 «(NMUO) 40 


+ = 


SNSN3D O£61 2 IW? HAUM VAVG Ydd LZEAS HLO HiY : 
82/81/20 VIVO G3193N9CD ONISN SAV IdSIO IWNOESIH 








8Z46L ‘TL WIGW3Ld9S ‘AVGSINI—~ZZL ‘ON ‘Eb “IOA ‘83151938 1V4I0s4 


SUVTI0G ‘LNANAIVId Yad LSOD 
00°000Z2tT OO*0080T 00°0096 00 °004%8 00°0022 00 °0009 00 °O00R* 00° 009 00°CO92 00° 0071 v°o 


ie Taal Catatate Datars Dat tatas Date ated, Datasheet Ratatat Datetetah Releseeh Deletes Loteteteh betetel 2 etetateh beteteteh eteted 0 Seteteted teteteheh teteteteh teeta hate 
Zon wt % w BEYIIZZSEE EF SZYZG HE HEZOF OE BLY EGFOLIZYEZEDEGS Cae eefe ae 4 


* * * + se t4 wZe€ wa2b a2 0S 2E 9 HZEYGS 2424 OR YN6 OR 69LS SOBZ NLL G99 42 ne 


H-[ suozpsay- 
OI-S suoysay- 


. 


o 
oc 

. 
- 


os oe & 5 Z afez 2 ae 


| 


GUruL HOIH GULHL a1aGgin GYIHL MOT 


eoee #2 & $4 é 21994 22% seat 2 


eZedeeZe = Zp € Eese227Ze Zuse & ae e€eee2 & 4% 


oS! 
co: 
7 


e>a222 H2eEeeede veer 4eo2ZE2 E> siden = 2 


wv 
bed 
Y 
= 
© 
z 








Ci ek ee ee ee we ee ee ee sess tp maa o> Ginges =: 





| 
| 
| 
“| 
| 





* * + eee * *]e © * 


OO°OO4Tt O00°00Z01 00°0006 00°0082 00°0099 00°004%S 00°0024 00°000€ 00°008 1 00°009 
ANSWAD TdW3 G3IYZIINI B3d 1S5U9 OGIIVIds (SSUYNIV) NUI93¢% (NMOO) JO wWVu9ddAAVIS 


© aie oe & ow Oo Ow S OF oe ee ee SO oe we ee mS oe oe Ot ee OF ee oe OS ee oe oe Se me oe Soe oe OOO SS oe OO ee = 


SNSN39 0161 9 JWT HATA ViVO UWdd ALAd VIO HI> Py 
81/81/10 viv 03193ud09 ONISN SAVIdSIO IWNOID3a 





SL61 ‘Zi BAIWIIdTS ‘AVOSENI—ZZ1 ‘ON ‘Sp “IOA “SRLSIORY 1V 49034 


SUVITON “INANIOVId LOAALGNON Yad LSOd 


0O*000%t O0°009ZT OO°OUZTT f0°0086 00°00%8 00°0002 00°0095S N0°CO?Y 00°o982 00°00 o°0 
SEAMASTER FOEES Taos CI RER TASES SERA GaP ses REESE ASHE RNS R SOSH HANS EH hy Sone heeee tinsel aenadeeest oan} * 
* s *® eandua 2 ad eZ ZaZeesELEPVE eZ9VESOO IEE IGE IIS HSL OEWGEGHZZEDE el Ew uay 


2 s a9 € % 2 2 % He HHSaZZ9ZEZ9SS7LSESZB GE L9L 90 96E GUL OYE 7969E 922 9 we 


1 
’ 


9-1 su0y Soy - 
OI-§ suocyZoy- 


ae ve lee & 


i en reo 


! 
} 
1 


GuIHL HOIH QuINL ZIGCIW QuIHL AO! 


2 ls 
3 | 3 
. H ° 
~ j - 


ee 6 ee) OBL REEZe waalaZ1 CEs 2 F 


Nex 





S 
i] 

+ 
” 


ew 


el ee de a | 


i 
1 





=] 
] 

e 
- 


20 &¢ lag weeme E82 82252 € 2Sce beenee 2 @ 4 





So 
° 

° 
ww 


24 
i 
1 
i 
i 
+ 
1 
I 
i 
i 
+ 
j 
i 
} 
i 
. 
j 
i 
! 
i 
+ 
i 
{ 
1 
I 
+ 


Ses 


e 8282 Z ee eaCC hee? #€2ee2s se 








acee @ 22 ae Oye 








= 
So 

e 
@ 





°o 
° 

° 
o 


* weeaZee e¢€ 





© ce swe a ae) 


oo°ot . 


Belted Dette Cole Eo oe eet PE 


ae te ee ee ee ee re ey oe ee ee et ee oe eee 
fo) 
o 
° 
fad 


a a4 aria ‘a2 ae 

Bm mn hm oe Fa $a = 3 $n ng 2 on ot ot 4 
CO°OOEET OO°OOG6TI OO*OUSOT 00°00T6 oo°00led ,00°00€E9 00°006% 00 °O0SE 00°00TZ co°ond 
4N3W39V1d LIZYIUNUON Y3d 15093 YIUNONS (SSUYIV) NUIN3SYN (NKOG) 40 WVwOHILIVIS 





i ete ate ee he oe en 


4 
¢ 





— e —_— 





SSNS OL61 2 IW? HLIM WiVO 4dd LZAJ WO FLd : 
g 39Vd 84/61/40 ViVG U31948d09 INISN SAV IdSIO TWNOID3H 





8261 ‘Tl BIGWIIdIS ‘AVOSINI—ZZL “ON ‘Eb “IOA ‘B31SIDIY 1VAIGIS 


INOYad ‘ALVA LSOD JALLVULSININIY 
00°04 00°9¢€ 00°2E 00°82 00°%2 00°02 00°91 00°21 00° 00° 0°0 


© me ah we em fm we 8 oe a He = $e te et FE nm be me fb re a 8 hen § ee he oh we we fr wm Fe wn gow ¢* 


se2e oe 6 477) €e HOE 


%07 wadaNnn 


So 
i] 

° 
N 


ZEZZEEZSZSZEZZEoE Ewe E w oe 


‘ 


ZeeveeZ 2ZeoZ ZevseeZZs 0€ 


J 
i] 

e 
v 


#e%ee e292Z2% E2949 ZZZZe Ze€CEe & & 


/ 
ae rein 


© &  09b5995S5922EZ24EZESHC2bb*e Ze 2 2 


’ 


+ 
) 
1 
I 
I 
4 
! 
! 
1 
1 
+ 
t 
! 
I 
1 
+ 
! 
I 
1 
I 
+ 
1 
I 
J 
i 
*¢ 
1 
I 
i 
i 
a 
I 
1 
I 
' 
+ 
! 


NOTICES 


> 
> 

° 
2 


&..28%42 €2€ 2€ Eve .e7€ 227 #.. 


‘ 


] 
> 

° 
~ 


e668 228 2 


’ 
! 








% ZE2G2 2 #2E 82 





norot 


eo me ew we oe 6 oe ewe we So ae oe SE ee > oe we ee ee ee ee et oe 6 ee et eee © ee ie oe ee ee oe oe oe} es oe ee ee >} Be ot oe ee 


ee ee ee 


1 eeZeZZ e448 © 2 a * 


4 Pd rh me Fa et mn Fe pm many 








On hr an th nn oh nn § een gf og + + + 
oo°vEe 00°%E€ 00°0€ 00°92 00°22 o0°sT 00°oT 00°01 o0°9 o0°2 
JAIVY ASOD JALLIVUISINIWUW--SNIWOVY (SSOUNDV) NOI93Y (NMOO) JO W¥UOHSLIVIS 
SNOT99H 2 0. 


S3WIdd BES--VIVO IW1 2 3dSO *SSd “USS LLAS B10 Hie ‘ 
6 39Vd 84/42/40 S3IN3IDS WIDOS Hd HN JOVNIVE BwIDLSTAWAS 





aZ6l ‘Zi WIGWIIdIS ‘AVGSINI—L41 “ON ‘Eb “IOA ‘891SIO3Y TV 8903S 


(e188 330 v1e ¢ {Buzss;w vIUp eABY siOsucds oWTAd g) INDOAd ‘SANNA AIVIIVAV 40 (AUNLIGNAUXANON) LOOAUAVD JO ALVA 
00°09 Go*zs 0uU'%4 00°9¢ ou°sed 00°02 oo°zt ov*y 00°%%- o0°zt- 00°C e- 
© mm nf en fe a § a nm tae mm gen § Hee eH tennnt= “NPA SG SIRS EEREEY RE NRT IT IS alae at daa a 
p-1t sNorlogy ? a. = @ EB. wCauZastZe€SSGeZ LAGS eLablozysseocs GELYZIELEEKsh se & & 
Ol-¢ sNology s #«€6C€ Zee & Zeb sZasabs CSCIGLEZZASVESESLIGIOZGLYSED SE COOENOEaHSICZZnS 20 ow eh Rue 


. 


s 


Garni nor! (e3ep atqeuotysenb) 


€2eee 22 8 4% 


» 222 #2 CCeuseae Et #Z2aZehnee seen Ze Z ae 


ce & aCaeee Z @ @022€ 0 E2aeeZEZZ#92se2eo2 & & 


me ee meee eee = ——— = - = se eee. oe 


* * & eee 2@ 2 Ze s€2aEeeeh ZeaeZEoez Ze2Z2EEE9 € Zane s 


ann, ey 


NOTICES 
* 


I 
i 
1 
i 
* 
1 
1 
i 
i 
. 
i 
e 
i 
i 
< 
i 
i 
j 
i 
2 
i 
i 
! 
i] 
+ 
i 
i 
i 
i 
oa 


: 
! 


2 zs € 


o0°OT 








a ieee een Ree hee Rok he ao ee ne ee ee ee 


ke ee oe ee oe 2  ) 


tom n-t 4 * + ¢ + + + + 4 2 Toler 
00°9s 00°84 00°04 00°2¢ 00°92 00°9T n0°R 00°0- 00°e- 00°9T- 
SONNS JV VUVAV JO JLVY INDABUVI-LNOAYVIY (SSOUIV) NOI9S34 (NANG) 30 WYYdNALIVIS 
Lar Base os SNOT 93 

USI LLAd HIO H14 (GL/%1/%O = 3ivO NOILV3Y9) T4LLyd0 3113 


+ 





s 4 
+ te J ¥ 


S3W1Ud BE4--ViVO IW1 9 3dSO *SSa 
Ot 39Vd 61/92/90 SJINZIDS WIDNS ZHL WO IOVHIVG WITISTIVIS 





NOTICES 


The data from which the scatter- 
gram were plotted were derived from 
the Regional Automated System 
(RAS) during mid-February 1978. 
Since then, it is possible that some 
missing data have been added and 
some incorrect data have been updat- 
ed. In any case, please review the data 
to insure that our data and computa- 
tions agree with your data and compu- 
tations and advise the national office 
(Attn: TDCR) of any needed correc- 
tions. 


Signed at Washington, D.C., this 
3lst day of August 1978. 


ROBERT J. McConnon, 
Deputy Assistant Secretary for 
Employment and Training Ad- 
ministration. 
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